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Summary:  Let  (X^,  i ^ O)  be  a sequence  of  independent  identically  distributed 
random  variables  with  finite  absolute  third  moment.  Then  Darling  and  Erdos 
have  shown  that 


Jln_n  - Hn  411 

P(U  < Y + ^-5^ ^ 7-  ) = exp(-e-^) 

n-^  “Si 

X 

^i=0  ■^i 

for  -00  < t < « where  u = max  r — and  Y = (2  Aniln  n)  . The  result  is 

” CKk^n  ^ 

extended  to  dependent  sequences  but  assuming  that  {X^}  is  a standard  stationary 

Gaussian  sequence  with  covariance  function  {r^^}.  When  {X^}  is  moderately 

dependent  (e.g.  when  v(  X^^)  /v,  n“  0 < a < 2)  we  get 

H 

Jln(-^  AnJln  n) 


1 1.  2n' 


''“n  i X„  * 't  - 2’ 


+ |-  ) = exp(-e"^) 


where  is  a constant.  In  the  strongly  dependent  case  (e.g.  when 


v(^"_l  X^)  % n^r(n))  we  get 


Ibi.  1/r  - Jin  4n 

1 h/T  * IT F ^ = e^P(-e  ) 

n-x»  ^'^n  ^1/T  ^1/r 

n ' n 


for  -00  < t < 00. 


1.  INTRODUCTION;  Let  {X.,  i ^ Ol  be  a sequence  of  independent  identically 
distributed  random  variables  with  mean  zero  and  variance  one.  Many  classical 
problems  have  come  out  of  the  study  of  the  partial  sums  The 

celebrated  law  of  the  iterated  logarithms  (LIL)  gives  the  first  order  terms  in 
the  growth  of  Sj^.  It  states 


(1.1) 


lim  1 

k-w  (2kJlnSn  k) 


Sometimes  the  LIL  is  stated  in  the  following  Feller  form,  giving  information 
about  the  second  order  terms.  For  (|)(n)  positive  and  nondecreasing 


(1.2) 


P(S.  > k^  (|)(k)  i.O.)  = or  according  as 

1 

I exp(-H  (J)^(n))  or  . 


The  quantity  Sj^/k^  in  both  (1.1)  and  (1.2)  can  very  easily  be  replaced  by 

max  S./i**  . In  this  paper  we  will  be  interested  in  the  behavior  of  this 
l^i<k  ^ 

maxTmum.  Besides  the  fixed  growth  rate  given  so  precisely  by  (1,2),  the 

randomness  of  max  S./k^  is  also  of  interest.  Darling  and  Erdos [3]  prove  that 
l<i<k  ^ 

if  {Xj}  has  finTte  absolute  third  moment  then 


(1.3) 


ilr(jln-n/4n'> 


'’^I'S^n  4 1 An  n)**  + ^ } = expC-e"^) 

n-xo  l<k5i  2 2(2An-njS  (2An-n)^ 


for  all  -<»  < t < «>.  As  usual  An  n = iterated  logarithm  of  n. 

q 

The  invariance  principle  of  Erdos  and  Kac  offers  an  elegant  tool  to  prove 


these  results.  The  required  results  are  first  proved  in  the  special  case  when 
Xj^  are  normally  distributed.  The  Central  Limit  Theorem  lets  us  approximate 
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partial  sums  Sj^/k  by  normal  variables.  The  results  then  follow  by  essentially 
concluding  that  this  approximation  is,  in  fact,  very  good.  Thus  the  study  of 
the  partial  sums  from  the  stationary  Gaussian  sequences  is  more  significant 
than  any  other  particular  case  in  this  area. 

From  now  on,  let  {X^}  be  assumed  to  be  Gaussian.  It  is  interesting  to  see 
how  (1.2)  and  (1.3)  are  affected  when  the  assumption  of  independence  among  X. 
is  relaxed.  Theorem  4 of  Lai  and  Stout  [5]  states  the  following. 

Theorem  (Lai  and  Stout).  Suppose  there  exists  0 < a < 2,  y > ci/2,  M>1,  6>0,  6>0 
and  positive  sequence  {L(n)}  satisfying  the  following  conditions 

(i)  n°‘L(n)  <<  v(n)  « n®L(n)  as  n -»•  <»,  v(n)  = variance(^?_j  ^) . 

M(^)^  if  6n  > m > M. 


(iii)  lim  sup  | ..a  MlL  I < 

nJo  ^n(jlniln  n)  < j < n L(n)  ^ 


(1.4)  and 


lim  inf  { .-g  . } > 0 

‘n(«ji£n  n)  £ J £ n L(n!)  J 

(iv)  V p > 0 there  exists  m^  and  1 > > 0 such  that  if  A n > m > m then 

p-p  p__p 

,m  P L(n)  n.P 


Let  <Kt)  be  a positive  nondecreasing  function  on  [1,“).  Then 


(1.5) 


P(S  > (v(n))^<^(n)  i.o.)  = or  according  as 

1 

ifsti 


In  Sections  2 and  3 we  extend  (1.3)  in  the  cases  of  moderately  and  strongly 

dependent  stationary  Gaussian  sequences.  We  prove  that  if  M = max  S./(v(i))’ 

" 0<i<n  ^ 


and 


(1.6) 


v(n)  n^L(n)  as  n “ 


with  some  additional  conditions  on  the  slowly  varying  function  L(n)  to  make  it 
well  behaved  then 


(1.7) 


It  1 1 An(c  £n2n) 

n!;  < C2Jln  n)"*  + ( i . l ) « 2 

n-x»  n — 2 a 2 


(2£n2n) 


(2Jln,n)' 


) = 


exp(-e"*) 


for  all  -»  < X < <».  Also  if 


(1.8) 


v(n)  -v.  (1  + o(, — ^.))  n^r(n) 

XAn  n)® 


for  some  0 > 0 again  with  some  additional  conditions  on  r(n)  then 


u Jln_  1/r^-  )!,n4II  ^ „ 

(1.9)  It  P(y^  < 1/r^)^  + ?S  — ^ S ^ ^ ^ + exp(-e‘'') 


n-KX) 


(2jln2  1/r^)  " (2iln2  l/r^^)' 


for  all  -00  < X < 

The  proofs  as  in  [3],  compare  the  maximum  to  that  of  a suitably  chosen 
stationary  Gaussian  process  on  an  appropriate  set.  The  sketch  of  the  main  idea 

jj 

is  as  follows.  We  know  that  even  though  {Sj^/(v(k))^}  forms  a standard  Gaussian 
sequence,  its  no  longer  stationary.  However,  we  could  view  this  as  coming  from 
a stationary  process  being  sampled  with  increasing  frequency.  If  v(k)  'v<  k°^L(k), 
0 < o < 2,  then  sample  from  an  a-process  (i.e.,  the  correlation  function  near 
the  origin  is  'v  1 - >s|t|“)  at  points  1,  1 + j,  ^ j*  •••»  Ii=i  •••  • 

Thus  we  have  n observations  for  this  a-process  in  the  interval  about  [0,Jln  n] . 
The  maximum  of  these  n observations  closely  approximates  y^.  In  this,  what  we 
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call  a "moderately  dependent  case",  the  frequency  of  sampling  does  not  depend 
on  the  covariance  function  of  {X^}, 

It  is  interesting  to  note  that  the  above  procedure  fails  when  a = 2.  Oddly 
enough,  we  observe  that  in  this  case,  the  normalized  sums  process  can  be  approx- 
imated by  a Brownian  motion  with  transformed  time  axis.  If  we  have  to  carry 
the  above  analogy  in  this  case  as  well,  then  we  have  to  sample  an  a = 1 process 
at  a frequency  that  depends  on  the  covariance  function  of  the  X-process.  At 
any  point  k,  instead  of  placing  the  next  observation  at  a distance  1/k  from  the 
k^^  observation,  we  place  it  at  a distance  approximately  |r' {k)/r(k) | . We  will 
call  this  the  "strongly  dependent"  case.  Thus,  in  this  case,  approximates 
the  maximum  of  a a = 1 process  on  the  set  [0,  An  • This  allows  arbitrarily 

slow  growth  rates  of  by  choice  of  r^.  Though  not  surprising,  it  is  inter- 
esting to  note  that  in  all  cases,  only  the  double  exponential  is  obtained  as 
the  extreme  value  distribution. 

There  may  seem  a discripancy  between  (1.5)  and  (1.9).  According  to  (1.5), 

2 

if  v(k)  = k L(k)  satisfying  (1.4),  then  the  first  order  term  for  y^  is 
(2  lln2n)^  while  as  (1.9)  places  it  at  a much  smaller  number  viz  (2  l/r^^)^. 

None  of  the  covariances  looked  at  in  (1.8)  satisfy  (1.4).  In  fact,  we  could 
not  find  any  examples  of  covariance  functions  satisfying  (1.4)  for  a = 2. 

The  next  two  sections  give  exact  statements  and  the  proofs  of  the  moderately 
and  the  strongly  dependent  cases  respectively.  Examples  of  covariance  functions 
satisfying  the  given  conditions  and  some  comments  are  in  Section  4. 

2.  MODERATELY  DEPENDENT  SEQUENCES;  Throughout  the  remaining,  {X^^,  i^0}will 
be  a stationary  Gaussian  sequence  with  mean  zero,  variance  one  and 
ti  = E XpX^.  Let  v(k)  = variance  of  X^;  = (v(k)) X^  for 

k = 0,1,2,...  and  y = max  Y.  . 

" 0<k<n 


J 
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Theorem  2.1;  Suppose  that  for  sufficiently  large  k, 


(2.1)  r.  = k\(k)  > 0 , 


-1  < 6 < 1 and  L(k)  is  a slowly  varying  function  satisfying 

Ci)  for  sufficiently  large  £,  is  bounded  if  k > 0 > 0 and 

(2.2)  (ii)  if  £ > k,  k ->  «>  such  that  (£-k)/k^"^  -*•  «>  y v > o but  c I 

~ k 

for  0 ^ c < » then  j 

! 

i 

1 

£t  £ L(£)  - L(£  - k) 

k-^  k L(£  - k) 


Then  for  a = 6 + 1, 


(2.3) 


£t 

n-x» 


p(y  < 6 


exp(-e‘^) 


for  all  -oo  < X < oo  . We  write 


L (1/a  - l/2)£n-n  f £n(H  //W) 

x„  = ; 6„  . x„  . 3 

n 


and 


T-w  ^ 0<t<T 


where  C(t)  is  a separable  nonstationary  Gaussian  process  with  E ^(t)  = -|t|“ 
and  Cov(?(s).  ?(t))  = |s|“+  |t|“-  |s-t|“. 

Before  we  proceed  to  prove  (2.3),  we  will  state  and  prove  two  lemmas  about 
E which  will  simplify  the  proof  of  the  Theorem. 


Lemma  2.1;  For  [expCean)]  _<  k < A < [exp(e(m+l)D ] , e > 0 and  m sufficiently 
large . 


(2.4) 


i - (*s*e')  E Y^Y.  < 1 - (Ss-e') 


k‘«,  - 


By  e’  we  denote  a small  positive  number  depending  on  e,  not  necessarily  the 
same  at  all  places.  Also  [•]  denotes  integral  part. 


Proof  of  Lemma  2 


Since  v(k)  = r^,  (2.1) 


and  Theorem  1 in 


([4]»  P8-  273)  gives  that  v(k)  is  regularly  varying  with  exponent  a = 6 + 1 and 


(2.5) 


l/g  k”l.(k) 


TTFoT 


-►I  as  k -> 


Define  r^.  Then 


E Y,  Y,  = 


v(k)  . 


^ ^ (v(k)v()l))’5 


(2.6) 


(V(k)v(ll))’*  - (V(k)  + 

= 1 j 


= 1 - 


(v(k)v(il))^ 
v(k)v(Jl)  - (v(k)  + 


v(k)v(£){l  + (v(k)  + a)^^)(v(k)v(a))'^}’ 

v(fc-k)  + 2 


Notice  that  v(£)  = v(k)  + v(£-k)  + 2 and  define  

Then  the  R.H.S.  above  is  equal  to 


(2.7) 


1 - 


v(£-k)  - o4ji/v(k) 


v(ll){l  + (v(k)  + u)j^^)  (v(k)v(£))"'^  } 


v(«.-k) 


FTkT 


{1  - 


u> 


JUc 


-u 


} (1  . E^^)  (1  . (1  . E^^) 


(v(k)v(£))' 


1 


1 
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We  need  to  show  that  the  product  of  the  last  three  terms  in  (2.7)  could  be 

bounded  above  and  below  by  ^ e*  as  k At  (a) , (b)  and  (c)  below  we 

find  bounds  for  various  quantites  involved.  First  we  look  at  v(Jl-k)/v(k) . 

The  argument  used  here  is  repeated  several  times  during  the  rest  of  the  text. 

0 

We  have  0 £ )i,-k  £ e'k.  If  (Jl-k)  < k for  some  0 < 0 < 1 then  we  can  write 
v(£-k)  < L()!,-k)  k°^®  for  large  k and 


v(fc-k)  L(fc-k) 


Since  L(t)  is  slowly  varying  function,  we  know  that  L(t)  t 0 and 
L(t)  t^  -»■  « as  t ->■  00  for  all  y > 0.  If  k®  < Jl-k  £ e'k  then  by  (2.2(i)), 
^L(k)^  bounded.  Thus 


v(J!,-k)  |v(k)  < e' 


for  all  k sufficiently  large.  Next,  we  will  look  at  For 


large  k,  by  (2.1)  we  have 


Hence 


< (const.)  (£-k)A(£) 


v(k)v( 


_<  (const.)  (-^) 


L^(^) 

L(k)L(J!,-k) 


The  fact  that  we  need  (J!,-k)  sufficiently  large  to  make  the  approximation 

v()l-k)  (il-k)^^*^  L(J,-k)  is  inconsequential  here,  since,  if  (H-k)  is  too  small 

0 

then  the  L.H.S.  above  is  obviously  small  for  k large.  If  (J.-k)  £ k then  the 


I 

ij 
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R.H.S.  above  tends  to  zero  as  k “ by  same  argument  as  at  (a)  and  if 
(f-k)  > k^  then  L(f)/L(J!,.k)  is  bounded  by  (2.2(i))  and  L(f)/L(k)  is  always 
bounded  for  the  range  of  i and  k under  consideration.  Thus 


Kill' 


for  all  k sufficiently  large.  Obviously 


(v{k)v(il)) 


< e'  as  well.  Finally, 


f ^ / LU) 

- k '•  k L(kT  - ^ 


for  all  k sufficiently  large.  Substituting  in  (2.7)  we  get  the  result. 


Lemma  2.2:  If  £ > k -*■  « such  that  £.-k  > !r  for  some  6 > 0 then 


(2.8) 


k-H»  (v(k)v(£)) 


^ • (f  ) =0 


for  some  y > 0- 


Proof  of  Lemma  2.2:  We  can  write 


“ llu-l  Ji-(l-j)  'i  - ''Wl 

< 1^=1  L(£-j) 

==  1/a  (£“  L(£)  - (Jl-k)®  LOl-k)) 

$ 1/a  (£“(L(£)  - L(£-k))  + akA*^  L(]l-k)) 

=.  L(t-k)  (1  . ^ ) . 
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If  H/k  is  bounded  then  we  can  bound  the  terms  in  the  bracket  above  by  a 
constant  since  p ^ is  always  bounded  for  il-k  ^ Jl®  by  (2,2{i)),  If 
Z/k  ^ oo  however,  then  ^ -►  0 by  (2.2(ii)).  Thus 


Z/k  <*>  however,  then 


0 by  (2.2(ii)) . Thus 


kil"L(Jl-k) 


j~  ^ (const.)  y2  ^ 

(vCkUCZ))^  (L(k)L(il))'^ 


= (const.)  (y) 


L(£-k) 

(L(k)L(Jl))'^ 


1-6  Y 

Choose  0 < Y < ~y~  • Then  the  R.H.S.  above  is  o((k/£.)  ')  as  k -»•  <»  because  here 

both  L(Jl-k)/L(k)  and  L(i!,-k)/L(£,)  are  bounded  due  to  (2.2(i))  (Notice  that  the 

case  6 = 1 is  excluded) . 

We  now  turn  to  the  proof  of  the  Theorem. 


Proof  of  Theorem  2.1:  The  proof  is  split  into  two  parts.  First  establishing 


(2.9) 


lim  inf  p(y^  £ ^ ^ exp(-e"^) 

n-w  ^n 


, -h  rk 


for  -00  < X < oo.  We  recall  that  p = max  Y.  where  Y,  = (v(k))  I . , y • 

" 0£k<n  K 1=1  1 

The  constants  6 and  X are  defined  after  (2.3). 
n ^n 

We  will  split  {Y.,  1 < i < n}  into  blocks  t < i < t ,,  m = 0,l,...,m_ 

^ 1*—  — m—  m+1  ’’’0 

where  t = fexp(era)l  for  some  e > 0 and  m^  is  such  that  t = n.  We  will  find 
m ^ 0 m^ 

a lower  bound  for  the  probability  in  L.H.S.  of  (2.9)  by  treating  Y^  in  different 

blocks  as  independent  since  E Yj^Y^  will  be  shown  to  be  nonnegative.  Now,  suppose 

il-k  “ 

E was,  in  fact  equal  to  1 - *2(^j^)  • Let  ^(t)  be  a standard  stationary 

Gaussian  process  with  covariance  function  1 - (h  + e) Itl*^  for  0 £ ^ We 

can  sample  {C(t),  0 £ t £ e}  at  points  Sj  where  Sj  = and  Sj^  = Sj^  j + 

It  would  be  easy  to  see  that  max  C(s.  ^ provides  a stochastic  upper  bound  for 

k 


|P(u  <u)-P(u'<u)l<P(  max  Y.  > u ) 


10 


max  Y.  . However,  by  using  Lemma  2.1,  we  can  get  explicit  bounds  for 

t <k<t  +1  ^ 

m m 

E only  when  (il-k)  is  large.  Thus  it  is  necessary  to  delete  all  but  a 

subsequence  {Y  } of  variables  from  the  m^^  block.  The  proof  will  follow 
m,h 

this  general  outline.  To  start  off,  we  also  need  to  exclude 

from  consideration,  since  all  the  bounds  gotten  in  the  Lemmas  work  only  for 

large  k. 

For  the  first  part  of  the  proof,  define  “ Pjj  Th®^  for 

y ' = max  Y, 

" (Jlnn)^2<k<n 


_<  (2,nn)^  (j)(u^)/Uj^ 


-U  2 

where  <t)(u)  = (2II)  ^ exp(-u  /2)  . The  R.H.S.  above  tends  to  zero.  Thus  we  can 
replace  by  y^'  in  (2.3). 


We 


will  prove  (2.9)  with  y replaced  by  y For  k and  I large  E Y.Y.  > 0 

H II  K X. 


I 
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Then 

(2.11) 


p(  max 

t <l<t  . 
m—  m+1 


V,  i i P(  V i “n  - ^ ' 

0<h<2m  m,h  m 


- P(  max 

t <l<t 
m 


m+1 


^ to  m ^ 

h ^ 

m 


where  a'  < a.  We  will  get  an  upperbound  for  the  R.H.S.  above  by  using  the 
following  result. 

Theorem:  (Marcus  and  Shepp[6]);  Let  (5^^,  i ^ 1}  be  a sequence  of  jointly 

Gaussian  random  variables  with  P{sup  jY. | < “}  = 1.  Then,  letting 

i^l 

2 

a = sup  var(Y.),  for  p>0  and  all  sufficiently  large  t,  we  have 
i>l  ^ 


(2.12) 


P(suq)  |yJ  > t)  < exp{-(l  - p)t^/(2a^)} 
i>l  ^ 


In  order  to  apply  this  to  Z.,  we  need  to  verify  that  P(  max  Z.  < »)  = 1. 

^ t <£<t  . 

m—  m+1 

It  is  sufficient  to  verify  that  max  Y.  is  finite  with  probability  one. 

t <«,<t  , ^ 

m-  m+1 


By  (2.4),  for  t^  £ k < £ < t^^^j  and  m large. 


(2.13) 


® Vt  ± 1 - (■> 


We  write  the  first  inequality  above  for  the  sake  of  convenience.  For  (£-k)  too 

small,  we  may  not  be  able  to  write  v(£-k)  (£-<)**  L(£-k) . However,  the  second 

inequality  is  correct  for  large  k since  we  have  chosen  a'  < a.  The  argument 

for  other  values  of  (£-k)  is  similar  to  the  one  used  before.  Now,  for  values 

o_k 

of  k and  £ under  consideration  0 ^ < e.  By  Slepian's  Lemma  [11], 

max  Y.  is  stochastically  smaller  than  the  maximum  of  an  a'-process  (i.e., 

t <£<t  , ^ 

m—  m+1 


correlation  near  zero  is  1 - (const.)  |t|“')  on  the  set  [0,e],  The  later  is 
obviously  finite  with  probability  one.  Thus  from  (2.12)  we  have 


(2.14) 


"'t  <S  ^ 


m ' a 


where  o = max  Var(zJ.  But  for  t ^<£<t  .. 

t <£<t  , m,h+l' 

ro—  m+1 


Var(Z^)  = V(Y^  - ) 

m,h 

=2(I-Ey^Yt  ) 

m,h 

£-t 

£ 2e'  (-p51iil)  using  (2.13) 
m,h 


< e'( 


I .-^m.h+l  ~ ^m.h. 


o' 


m,h 


£ e'  m"“  for  all  h = 0,1,..., 2m. 


Hence  the  R.H.S.  of  (2.14)  is  at  most 

exp{-  (const.) (£n  m)^} 


and  the  R.H.S.  of  (2.10)  is  at  least 


0 

n {P(  max  Y _<  u 
®”"'l  0£h£2m  ^m,h  ” 


£n  m . 
m 


exp (- (const. ) (£n  m)^)} 


(2.15) 


= E n P(  max  Y < u 
“l  m=mj  0^h£2m  ^m,h  ” 


a^/2  ^ 
m 
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where  E = 11  {l  - exp(-(cQnst.)  (/In  m)^)/  P(  max  < u - }.  We 

1 m=mj  0£h<2m  m,h  ” m 


have  established  before  that  max  Y is  finite  with  probability  1 for  all 

0<h<2m  m,h 


Jin  m 


m.  Hence  P(  max  Y.  < u mr)  -»•  1 as  n -+■  » and 

0<h<2m  \h-  " 


00  3/2 

^ exp{- (const.)  ^ }. 


m=m. 


The  R.H.S.  above  tends  to  one  as  n -►  ».  It  remains  to  show  that  the  product  in 

R.H.S.  in  (2.15)  is  bounded  below  by  the  required  limit.  Now,  since  t . and 

m,h 


tjjj  j are  sufficiently  far  apart  for  h / j,  we  can  write 


E > 1 - Cl,  ♦ e-)  c^^)“ 


for  values  of  k and  1 in  the  set  t = {t  . , h = 0,1,... ,2m}.  Notice  that  for 

m m,n 


such  values  of  k and  Jl,  (Jl-k)/k  cannot  tend  to  zero  very  rapidly  i.e., 
(Jl-k)/k^"^  -»■  » V Y > 0.  Hence  applying  (2.2(ii))  we  have  L(il-k)/L(£)  -►  1. 
Also,  since  £ £ (1  + e)k,  L(£)/L(k)  -►  1 as  well.  By  choosing  an  appropriate 
value  of  e',  we  can  write  for  large  k that 


E Yj^Y^  > 1 - (}i  + e')(-?:^) 


a 


for  k,£  e Let  {^(t),  t ^ 0}  be  standard  stationary  Gaussian  process  with 

covariance  function  1-  (^s+e')  |t|®  for  0 £ t £ e*  We  see  that  the  covariance 

matrix  of  {Y„,  £ c x } is  bounded  below  by  that  of  {£.  „ , £ e x }.  Thus 
£ m £-t_  m 


m 


max  Y is  stochastically  bounded  above  by  max  ^ which  is  at  most 

0<h<2m  m,h  0<h<2m  m,h"  m 

t_ 


m 


J 
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max  C(t).  Thus  the  product  in  the  R.H.S,  of  (2.15)  is  asymptotically  at  least 
0<t<e 


(2,16) 


exp  {-  I P(  max  ^(t)  > u - )} 


m„ 


“0 

[ 

m»m 


1 


2/a-l 


•>.  exp  (-  r ^ ) ■ " ♦(u^  - ^)ft  • H„) 


by  Lemma  (3.8)  of  Pickands  [9].  is  defined  in  the  statement  of  Theorem  2.1. 
Substituting  the  value  for  u^^,  we  have  the  R.H.S.  of  (2.16)  asymptotically  equal 
to 

»0 

(2.17)  exp  {-  (1  + 2e')^/“  exp(-x  + o(l))  I exp(Ujj  Jin  m/m"'/^))  . 


m-m. 


Spliting  the  sum  into  two  parts  say  mj  £ m £ (mQ^**  1 “o' 

for  large  n 


-“0  j 

I exp(u^  £n  m/m°‘'/^)  < m^**  exp(u  ) + m^  exp(l/(]ln  m)“'^^)  = m (1  + o(i)), 
m=m 


Substituting  in  (2.17)  we  get  that 


lim  inf  p(y^  1 > exp(-(l  + 2e')^^“  e"^) 


n-x» 


for  all  e*  > 0.  This  concludes  the  proof  of  (2.9) 
It  is  much  easier  to  show  the  otherside  viz, 


(2.18) 


lim  sup  P(u  1 3 + x/v  ) _<  exp(-e"*) 
n-x» 


We  just  exclude  the  appropriate  number  of  Yj^  and  then  compare  them  with  variables 
selected  from  an  appropriate  a-process  by  Berman's  Lennna  [IJ.  Let  u^,  m^  and  m^ 
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be  the  same  as  defined  before.  We  will  define  new  subsequences  and  the 

sets  T^.  To  avoid  clumsy  notation,  yie  will  use  the  same  symbols.  Thus,  it 

should  be  noted  that  t . and  x are  defined  two  different  ways  in  this  section 

m,n  m 

and  two  different  ways  in  Section  3.  All  efforts  to  try  to  define  a subsequence 
that  will  work  for  both  parts  of  the  proof  in  each  section  have  failed  so  far. 
Care  should  be  taken  in  noting  an  appropriate  definition  of  t^  and  x^^  in 
reading  different  parts  of  the  proof.  Let 


^m  h “ t®xp{e(m  + 

(Hn  m) 


and 


^m  “ ^^m  h’  ° = nij^  say}  . 


(i.e.,  we  have  clipped  a small  portion  from  the  right  hand  side  for  each  of  the 

sets  X ) . Now 
m 


m. 


(2.19) 


P(Vi  < u ) < P{  n ( max  < u„) } 

n— n—  ^ t.— n 

ni^lDa  t lU^K 

1 n^n  in 


“o  ”o  ^Si  % 


0 "0  “0  X,  "h  u 

< n P(  max  Y 1 u ) + C n II  Ppjlqh  ^ • 

B t €X  ^ ff-1  h = 1 i ^ Pp.n-1. 

1 m,h  m 


m=m,  t_  v€X_  ''m,h  “ p>q=mj  £.■!  h=l  * * ’ ^pj^h 


The  last  inequality  follows  from  Berman's  Lenuna.  C is  some  positive  constant 
and 


PpAqh 


E(Y.  Y.  ) 

T,£  ^,h 


if  P ^ q 


if  P = q . 
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2 

Notice  also  that  the  largest  value  of  (1  - depends  only  on  e and  is 


absorbed  in  C.  By  Lenaa  2.1, 


v(tp  0 - t , ) 

E Y.  Y < 1 , (J,  - e')  ^.-7^ 

T.ji,  q,h 


^Cip  0 ” t.)  tp  n - t , (X 

-V,  1 . (js . e')  — W ( _Pi| — aA  ) . 

'■  q.h-*  q,h 


Because  of  the  above  definitions,  when  P/q,  tp.-t  i,>t  |,(e^  - 1)  e t . . 

r , Jt  ~ q*n  qfh 

By  the  same  reasoning  as  before  and  condition  (2.2),  we  have 


(2.20) 


E Y Y < 1-e' 
P.A  q.h 


,2/a 


for  all  P / q and  q large.  For  all  m,  nij^  ^ (An  m^)  ' . Substituting,  an 
upperbound  for  the  sum  in  the  R.H.S.  of  (2.19)  is 


“a  2m-  2 

0 „ u_  0 


(2.21)  c J_  {m^  («n  mQ)^/“exp(-  y:|r)  * ^(An  ■no)^/“pp^j^  exp(-  > 


q=m, 


for  all  0<n<l*  u^'\-2  An-n  and  m-  'v^  ^ . We  choose 

n z VC 


n < eV(2-e')  for  the  value  of  e'  that  works  in  (2.20).  This  makes  the  sum  of 
the  first  term  in  (2.21)  to  be  o(l).  For  the  second  part  of  the  sum,  we  know 
by  Lemma  2.2  that 


v(t  . ) *5  A_  u Y 

® ’'t  ’'t  i 

^P,A  q,h  '''■^P.A'*  '^PpA 


for  some  v > 0.  But  v(t  .)/v(t„  , ) -v  (t  ./t„  )“  for  large  q.  Thus  for  some 

q,h  P,£  q,n  P,£ 


Y'  > 0 


_<  exp(-Y»e 


for  all  p 2l  *1  * (2.21)  is  o(l) . To  bound  the  product 

in  the  R.H.S.  of  (2.19),  we  define  a standard  stationary  Gaussian  process 
{^(t),  0 < t < e}  (different  from  the  one  in  the  first  part  of  the  proof)  with 
covariance  function  l-(5s-e*)  |t  near  origin.  We  bound 

P(  max  Y £ u ) £ P(  max  f 
^m  h^^m 

^m 

By  Lemma  (3.8)  of  [9],  the  R.H.S.  above  is  asymptotically  equal  to 

e(l-e)(l-e')^^“  H u (|)(u  ). 

an  ^ n 

Substituting  in  the  product  we  get  the  desired  result  (2.18).  The  details  of 
the  last  argument  are  very  much  similar  to  those  in  the  first  part  of  the  proof 
and  hence  are  not  repeated.  This  finishes  the  proof  of  Theorem  2.1. 

3.  STRONGLY  DEPENDENT  CASE;  In  last  section  we  considered  the  cases  when 
v(n)  '''  n°*L(n)  for  0 < a < 2.  In  this  section  we  will  have  a = 2.  The  sequence 
i 0}  and  are  as  described  in  Section  2. 

Theorem  3.1;  Let  f be  a probability  density  function  on  the  real  line  and  set 

<x<<»;  0_<y<<»  and  f(x+k)  > y}  . 


Assume  that  the  correlation  function  rj^  = EX^Xj^  satisfies 


(3.1) 


(i)  ^ A f(x+k)dx 

(ii)  for  k ICq,  \ n for  0 < k _<  H. 


Let  -*•  0 be  a slowly  varying  function  such  that  for  large  k 


(3.2) 


^ r^  = (2  + Ej^)k  rj^ 


with  E,  = o ( X ) nonincreasing  and  6 > 0.  Then 

Cln  k)” 


(3.3) 


for  all  -00  < X < 00,  Here 


PCVn  1 “ exp(-e'*) 


)^  = (2  Jin,  1/rn) 


Hn-  1/r  - Hn  411 
4 n 


Condition  (3.1)  is  used  and  discussed  in  Mittal  and  Ylvisaker  [7].  From 
discussion  there,  we  have 


X,  = (1-r^)**  ’^i’'  ^ ^k  0 < i < k 


k k 

where  and  Ij^  are  independent  normal  with  mean  zero,  var(Wj^  ) 


= 1 and 


E Ij^I^  =.  rj^  V Jl  ^ k.  Thus 


Zf  1 

„ ^i=l  1 ^ 

* T = (1-r,,) 


t-l  «i' 


(v(k))' 


^ (v(k))’*  (v(k))*s' 


The  general  idea  of  the  proof  is  to  show  that  the  variables  Wj^*^/(v(k))** 
are  too  small  and  hence  we  can  replace  the  process  {Yj^}  by  {klj^|  (v(k))**}.  (In 
fact,  we  replace  it  by  We  deal  with  the  new  process  in  very  much 

similar  ways  as  the  last  section.  The  following  Lemma  does  the  first  part  of 
the  proof. 


Lemma  3.1;  Under  the  conditions  of  Theorem  3.1, 


(3.4) 


lira  (An  k)  5.  = 0 a.s. 
k-«o 


for  all  6 > 0 sufficiently  small,  where 


Proof  of  Lemma  3.1;  Let  us  define  tj^  = [exp(k')]  for  0 < y < 1 and 


A,  = A,  (e)  = { max  ?•  > e} 
" t,.<i<t  . , J 


for  e > 0,  k = 0, 1, . . . . The  result  follows  by  symmetry  and  the  use  of 
Borel-Cantelli  Lemma  if  we  show  that  P(k)  < ».  To  compute  P(Aj^)»  we  find 

lower  bound  on  the  correlations  of  Cj,  £ j £ ^k+l‘  first  note  that  as  a 

result  of  the  assumed  conditions,  rj^  > 0 and  for  sufficiently  large  k,  rj^  ^ r^^ 
V i < k.  Now  for  j < A, 


(3.5) 


Jr  * r j(r^)^  h 

■ ^ ^ + (— ) • 

J (r.  v(A))^  (v(j))'*  ’'j 


J 


(v(j)) 


. (vO))**  - jr’*  r , 

} = r.^  { , J } 'V.  ( -^)^E.  ^ 0 for  large  j 

^ f-,.  r.  J 


(rjv(j)) 


But 
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and 


EY^Y 


^ (r^  va))^ 


(v(Jl))' 


(v(j))^  - I r. 


(v(A)) 


^ (Ej  - ^ 


) . 


For  < l,j  < ^<  (const.) 


J - 


Thus  for  large  j,  since  r.  > r., 

J * 


C,C 


jr. 


where  c > 0 is  a constant.  We  know  that  v(Z.)  = 2(1 i — p)  ^ e and  E is 

^ (v(j))^  j j 

nonincreasing.  Hence 


(v(Z^)v(zp)’* 


^ 1 - Cj  k for  t,  £ j,£  < t 


k+1 


Now, 


P(\)  = P(  max  C.  > 


e) 


(3.6) 


< P ( max 


C. 

-J. 


•'  k 


- K -t  * > e k2  } 


li 


'■k+1  '■k 


where  is  maximum  of  n independent  standard  normal  variables  and  U also 
standard  normal,  independent  of  M*.  An  upperbound  for  the  R.H.S.  of  (3.6)  is 
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t 

PCM*  > — 2 ) + 1 - ♦(  I ) 


where  $(x)  = (Ku)du.  Noticing  that  '\j  exp(k^),  we  see  that  the  above 

is  sunmable  over  k.  This  completes  the  proof  of  the  Lemma. 

Next,  we  can  replace  p in  (3.3)  by  v = max  I,/r,  = max  ru  because 

" ” 0<k<n  ^ 0<k<n  ^ 


and 


Xnl^n 


max  r, 
0<k<n  ^ 


Xjj/(£n  n)*^  -►  0 


as 


n -*■  00  for  all  S > 0. 


For  the  proof  of  (3.3)  with  in  place  of  p^,  we  follow  the  same  proce- 
dure as  in  Section  2.  We  compare  with  a sequence  sampled  from  an 

appropriately  chosen  (a=l)  process.  Unlike  Section  2,  the  frequency  of  sampling 
here  depends  on  the  covariance  function  Some  of  the  details  of  Section  2 

become  easier  here  in  view  of  the  observation  that  Ij^  = B(rj^)  where  B denotes 
a standardized  Brownian  motion.  Sketch  of  the  proof  is  given  below  avoiding 
repetition  of  arguments  in  Section  2. 

Define  (different  from  all  previous  definitions) 

t^  = [r-^e"^^)]  ; t^  ] 


and 


Here  r"^C6)  = win  r(t)  = 6.  Since  r is  monotone,  t,  is  nondecreasing.  Also 
t 

rfr~^(6)3  = <S.  By  similar  arguments  that  lead  to  (2.10)  we  have 


(3.7) 


P(v’  < u ) > n P(  max  n < u ) 

..  - t.—  n 

m=m,  t .ex  m,k 

X ni  p K m 


h 

where  u = S + x/y_;  m^  and  m,  are  such  that  t (An  n)^  and  m«  = min{m|t  > n}. 
nn'Tiui  0 'm  — 

Also  v'  = max  H.  . Define  Z.  = rin  - 0*  for  t , < A < t , Then 

" (ton)^<k<n  ^ ^ ^ Vk+1 


P(  max  Hn  < u ) > P(  max  ) 


t <A<t  . 
m—  m+1 


0<k<2m  m,k 


P(  max  2 > ^^  ). 

t <A<t  , ^ m^ 

HH-  m+1 


I t 

nf  mov  7 ^ An  m^  r ^ Ti f mnv  A m,k+l  An  m . 

P(.  max  Z.  > ■ V'~)  ^ (2m  +1)  P(  max  — j-  - t ' — > V ) 

t <A<t  , m^  t , <A<t  . , r„^  r; 

m-  m+1  m.k—  m. k+1  A t , , 

' ’ ro,k+l 

< (2m+l){P(  max  ^ Am  k+1  j,  Ann  ^ 

"m.kl^<^m.k+l  ^A 

+ P(  max  I ir'X  >^)) 

^n.ki^^^.k+1  “ 


(3.8)  £ (2m+l){P(  max 


/ T T \ X.  An  m ^ X 

max  (I.  - I ) > — j-  r ) 

t • <A<t  , , m,k+l  m"^  m,k+l 

m.k—  m,k+l  ’ ' 


P(I,  (rl'^  -r-'* 

m,k+l  m,k+l  m,k  m^ 


Since  I.  = B(r.),  we  can  write  I.  - I as  B(r-  - r ).  Using  proposition 

Xp  Xp  XpTl.^1  XpLi.« 

m,k+l  m,k+l 

12.20  of  Brieman  [2],  we  get  the  first  probability  in  the  R.H.S.  of  (3.8)  to  be 
atmost 


f 
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(3.9) 


2P(It  - rj  ). 

in,k  m,k+l  m,k+l 


2 

But  r '''  exp(-e(m  +k)  ) . Thus 
m,k 


var(I  - I ) = ~ 

m,k  m,k+l  m,k  ^m,k+l 


-e 


exp(-e(m^  + k + 1)"^)  [e^™  - 1] 


2m  t 


I f ^ An  HI. 
e ({,(2  -— ) 


and  (3.9)  is  at  most 


Jin  m 


m,k-*  1 


. Substituting  values  for  r , we  get 

m,k 


approximately  the  same  bound  for  the  second  probability  in  the  R.H.S.  of  (3.8) 
Hence 


(3.10) 


, - to  . , 

P(  max  Z.  > — ) < = — 

t <J!,<t  , m'^  ■”  Jin  m 

m—  m+1 


The  R.H.S.  of  (3.10)  is  summable  over  m.  Following  the  same  line  as  in  Section 
2,  it  only  remains  to  show  that 


P(  max  n*  < u ) '^'  e u (})(u  )(,h  + e')  . 
0<k<2m  ^m,k  “ " " " 


(Notice  that  the  constant  H^  for  a=l  is  explicitly  given  in  Theorem  4.4  of  [8]) 
Let  {£|(t),  t ^ 0}  be  a standard  stationary  Gaussian  process  with  covariance 
function  1 - (Jj  + e')  |tj  near  origin.  Then 
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E(n^.  T^,  ) = (r^  /r^ 

m,k+Jl  m.k  m,k+)l  in,k 

exp  {-j  ((m^  + k + 

^ , (l+e)e  A 

^ ^ ' 2 ^ 

4(m  +k)^ 


;l  - 


(n^  + k)*^) 


■ ,-t  • V 

m.  A m 


It  follows  in  the  manner  similar  to  Section  2 that 


(3.11) 


lim  P(y^  1 J 

n-x» 


(It  should  be  noted  that  r^  exp(-emQ)  > e"  Strictly  speaking,  the 

“o 

normalized  constants  for  the  ^ process  should  be  with  r^  replaced  by  r^  but 

“o 

it  is  easy  to  see  that  this  does  not  make  any  difference  in  the  limit.) 

The  procedure  for  the  rest  of  the  proof  is  now  apparent.  We  define  a new 


t . = [r"^  {exp(-e(m  + — =-  ))}]  . 

(An  m)^ 


The  fact  that  Ppj^jj  = E H^p  n|.q  decreases  rapidly  to  zero  for  p-q  > m^  is 
quite  obvious.  The  rest  of  the  arguments  are  very  similar  and  hence  not 
repeated. 

4.  EXAMPLES  AND  DISCUSSION;  Examples  of  covariance  functions  {r^^}  satisfying 
(2.1)  and  (2.2)  are  given  by  convex  (ij^),  = k~^(An  k)^  for  k ^ k^,  0 < y < 1 


and  A € IR  . (Defined  appropriately  on  [Q.k^]  to  make  it  convex).  For  {rj^} 
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"il 

satisfying  (3,1)  and  (3.2),  we  give  again  convex  = (^n  k)"  for 

k ^ kp  and  A > 0. 

The  proof  of  the  result  At  P(Vjj  ^3  + x/v  ) = exp(-e’'*)  can  be  greatly 

” h 

reduced  by  the  observation  Ij^/rj^*S  = ®^^k^^^k  result  of  Darling  and 

Erdos  [3]  as  given  in  (3.1)  of  Robbins  and  Siegmund  [10],  Darling  and  Erdos 
do  not  state  their  result  in  the  form  (3.1)  of  [10].  Also  their  proof  of 
Theorem  1 in  [3]  is  quite  complicated.  Theorem  1 of  [3]  is  a particular  case 
of  Theorem  2.1  and  the  last  part  of  Theorem  3.1  offers  an  alternative  proof  for 
(3.1)  of  [10]. 
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